# Efficient Distillation Model

FairyR1-32B is an efficient large language model based on DeepSeek-R1-Distill-Qwen-32B, optimized through distillation and merging processes, excelling in mathematical and programming tasks.

Llama model trained with Unsloth and Huggingface TRL library, achieving 2x faster inference speed

Llama model trained with Unsloth and Huggingface TRL library, achieving 2x inference speed improvement

Akshara-8B is a cutting-edge AI model specifically designed for India's multilingual ecosystem, supporting the understanding and generation of various Indian languages.

A 24B parameter model based on the Mistral architecture, distilled from the DeepSeek model, designed for speed and efficiency.

Distil-Whisper is a distilled version of the Whisper model, 6x faster with 49% smaller size, achieving near 1% WER on out-of-distribution evaluation sets.

MiniLM is a compact and efficient pre-trained language model, compressed through deep self-attention distillation technology, suitable for language understanding and generation tasks.

DistilRoBERTa is a distilled version of the RoBERTa-base model with fewer parameters but faster speed, suitable for English text processing tasks.